ABSTRACT 

e  plan  a  long-term  project  sched¬ 
ule  for  which  the  total  budget  de¬ 
pends  upon  the  year  the  project 
finishes.  Each  fask  in  the  project  can  begin 
only  when  all  its  predecessor  tasks  have 
been  completed,  and  each  task  has  a  range 
of  feasible  durafions  with  a  month-by¬ 
month  cost  profile  for  each  durafion.  A  task 
start  can  be  delayed,  but  once  started  for 
some  chosen  durafion,  a  task  cannot  be 
interrupted.  Each  task  suffers  some  risk  of 
delay  and  changed  cost.  Ignoring  budget 
constraints,  we  use  Monte  Carlo  simulation 
of  fhe  durafion  of  each  fask  in  fhe  projecf  fo 
infer  the  probability  distribution  of  the 
project  completion  time.  We  then  optimize 
a  deterministic  project  schedule  following 
budget  guidance.  Einally,  we  successively 
reschedule  as  the  project  progresses,  simu¬ 
lating  annual  review  of  active  tasks,  and 
possibly  delaying  each  active  task's  dura¬ 
tion  and  changing  its  monthly  costs  for  its 
forecast  duration.  We  do  not  require  an 
independence  assumption,  so  we  can  ac¬ 
commodate  learning  effects  from  com- 
plefed  fasks.  U.S.  Army  Eufure  Combat 
Systems  (ECS)  is  our  motivating  applica¬ 
tion.  ECS  is  a  complex  of  information  tech¬ 
nologies,  sensors,  and  command  systems 
expected  to  require  more  than  a  decade  and 
$16  billion  to  develop.  The  U.S.  General 
Accounting  Office  finds  ECS  at  significant 
risk  of  cosf  and  schedule  growfh,  and  sug¬ 
gests  two  alternatives  to  a  baseline  Army 
plan.  We  analyze  these  three  alternate 
project  plans  for  ECS  fo  discover  which  one 
can  mosf  likely  be  complefed  soonesf  and 
cheapest. 

"Now,  I'll  manage  better  this  time.”  Alice  in 

Wonderland 

INTRODUCTION 

U.S.  Army  Euture  Combat  Systems 
(ECS)  is  a  complex  of  information  technol¬ 
ogies,  sensors,  and  command  systems  con¬ 
stituting  a  project  with  scores  of  fasks  ex¬ 
pected  fo  require  more  fhan  a  decade  and 
$16  billion  (2004  U.S.  dollars)  just  in  system 
development  and  demonstration  costs.  In 
fiscal  year  (EY)  2005,  ECS  is  expecfed  fo 
consume  more  fhan  half  of  fhe  U.S.  Army's 
budget  for  all  system  development  and 
demonstration,  and  perhaps  $94  billion  to 


acquire  14  of  the  18  systems  needed  for  ECS 
inifial  operational  capability  by  the  year 
2010  (Brady,  2003;  Erancis,  2004).  The  U.S. 
General  Accounting  Office  (GAO)  (2003) 
finds  EGS  vulnerable  fo  significanf  cost  and 
schedule  growth,  and  suggests  alternate 
project  designs  to  mitigate  risk. 

Erancis  (2004)  outlines  the  accomplish¬ 
ments  that  must  be  coordinated  in  order  for 
EGS  fo  succeed,  which  we  paraphrase: 

•  A  specialized  C4ISR  (Gommand,  Con¬ 
trol,  Communications,  Computer,  Intel¬ 
ligence,  Surveillance,  and  Recormais- 
sance)  network  must  be  developed  for 
ECS; 

•  Eourteen  major  weapon  systems  and 
platforms  must  be  designed  and  inte¬ 
grated  simultaneously  with  other  sys¬ 
tems,  subject  to  physical  limitations; 

•  At  least  53  technologies  that  are  consid¬ 
ered  critical  to  achieving  required  per¬ 
formance  capabilities  must  be  matured 
and  integrated; 

•  At  least  157  Army  and  joint-forces  sys¬ 
tems  must  also  be  adapted  to  interoper¬ 
ate  with  ECS,  which  will  require  the  de¬ 
velopment  of  nearly  a  hundred  new 
network  interfaces;  and 

•  An  estimated  34  million  lines  of  software 
code  will  be  required  to  operate  ECS. 
This  is  nearly  five  times  the  software 
required  for  the  Joint  Strike  Tighter, 
which  had  the  largest  software  require¬ 
ment  of  any  Department  of  Defense  ac¬ 
quisition  prior  to  ECS. 

ECS  is  so  complex,  a  number  of  normal 
procedural  reviews  and  hurdles  have  been 
relaxed,  enabling  an  independenf  initial 
operational  test  and  evaluation  using  an 
incomplete  prototype  scheduled  for  2008 
(Welch,  2003). 

We  seek  a  "project  design"  for  such  a 
long-ferm,  high-risk,  complex  system.  We 
anticipate  that  higher-risk  tasks  will  exhibit 
more  imcertainty  and  thus  may  take  longer 
than  planned  and  cost  more.  We  are  willing 
to  state  probability  distributions  predicting 
the  cost  and  duration  of  each  fask,  but  we 
view  an  independence  assumption  be¬ 
tween  task  outcomes  as  foolhardy:  In  com¬ 
plex,  high-technology  projects,  trouble 
breeds  company. 

We  seek  a  "robust  project  schedule" 
that  offers  fhe  least  schedule  risk.  We  want 
to  plan  to  complete  our  project  at  some 
given  budget,  by  some  given  time,  with 
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some  given  probability.  We  can  rearrange  some 
of  the  planned  project  partial  orders  among 
tasks — i.e.,  what  predecessor  tasks  have  to  be 
completed  before  any  given  task  can  start — and 
these  rearrangements  might  influence  schedule 
robustness.  Our  problem  is:  which  rearrange¬ 
ment  offers  the  most  robust  project  schedule? 


SCHEDULE  OPTIONS  AND 
SCHEDULE  RISK 

We  refer  to  schedule  risk  as  the  costs  of 
schedule  overruns  evaluated  by  their  likeli¬ 
hoods.  Plarmers  might  be  presented  with  a  set 
of  options  for  scheduling  the  range  of  tasks  that 
comprise  a  large  acquisition  project.  These  op¬ 
tions  must  abide  by  a  common  set  of  temporal 
and  fiscal  constraints.  They  should  also  reflect 
the  inherent  uncertainty  of  the  completion  time 
of  a  developmental  task.  A  rational  plarmer 
assesses  the  schedule  risk  of  each  option  and 
selects  the  option  that  affordably  poses  the  least 
risk. 

Significant  "knowledge  demonstration" 
(i.e.,  showing  you  can  actually  build  compo¬ 
nents  that  integrate  in  the  system  design)  often 
occurs  late  in  development  and  early  in  pro¬ 
duction  of  a  major  defense  acquisition  pro¬ 
gram.  The  highest  schedule  risk  comes  when 
developed  components  must  be  integrated  into 
a  system  of  systems.  Welch  (2003)  observes  that 
the  unusual  complexity  of  PCS  exposes  it  to 
higher  schedule  integration  risk  than  normally 
expected  of  a  major  program.  In  particular,  PCS 
is  susceptible  to  "late  cycle  chum"  to  fix  prob¬ 
lems  discovered  late  in  development.  Francis 
(2004)  identifies  the  following  factors  that  dis¬ 
pose  PCS  to  late  cycle  chum,  which  again  we 
paraphrase: 

•  Technology  development  is  expected  to  con¬ 
tinue  through  to  the  production  decision; 

•  Technology  development  will  still  be  ongo¬ 
ing  at  the  design  readiness  review,  putting  at 
risk  the  stability  of  ongoing  system  integra¬ 
tion; 

•  Production  is  plarmed  to  start  while  technol¬ 
ogy  development  and  system  integration  are 
continuing  and  the  first  prototypes  are  being 
delivered; 


•  The  final  production  decision  will  be  made 
before  some  technologies  reach  their  re¬ 
quired  maturation  and  before  an  integrated 
system  demonstration  has  been  conducted; 

•  Production  delivery  will  start  before  the 
Army  has  completed  the  first  full  demonstra¬ 
tion  of  PCS  as  an  integrated  system;  and 

•  The  full-rate  production  decision  will  be 
made  while  testing  and  demonstration  are 
continuing. 

The  PCS  program  executive  office  has  pre¬ 
pared  a  baseline  project  plan  (i.e.,  a  schedule 
with  funding)  for  the  system  development  and 
demonstration  phase  that  governs  current  ac¬ 
quisition  policy.  Several  alternate  project  plans 
have  been  proposed  by  the  General  Accounting 
Office  (2003)  to  mitigate  PCS  schedule  risks.  We 
examine  the  baseline  plan  and  two  of  the  GAO 
alternatives  here. 


1.  “PCS  baseline”  plan 

The  baseline  plan  develops  all  major  sub¬ 
systems  concurrently,  rather  than  developing 
one  first  to  set  the  development  context  for 
follow-on  systems.  The  FGS  program  executive 
office  acknowledges  that  this  plan  is  ambitious, 
and  that  the  program  was  not  ready  for  system 
development  and  demonstration  when  it  was 
approved  (Francis,  2004). 

2.  “GAD  risk  first”  plan 

This  plan  modifies  the  baseline  to  address 
risky  technologies  up  front,  requiring  that  the 
technology  readiness  level  (a  gauge  of  comple¬ 
tion)  be  "at  least  6"  to  pass  intermediate  review 
and  "at  least  7"  to  qualify  for  production 
(Wynne,  2003).  Many  key  technologies  are  be¬ 
low  the  6  threshold,  and  the  FGS  program  ex¬ 
ecutive  office  has  already  developed  risk-miti¬ 
gation  strategies  for  each.  This  GAO  suggestion 
first  matures  technologies  that  are  below  the 
technical  readmess-6  threshold,  and  then  pro¬ 
ceeds  as  scheduled  in  the  baseline  plan.  The 
advantage  is  that  test  and  integration  tasks  oc¬ 
cur  later  in  the  schedule,  with  theoretically  re¬ 
duced  schedule  risk  compared  to  the  baseline 
plan. 


Page  42 


Military  Operations  Research,  Vll  N4  2006 


ESTIMATING  TOTAL  PROGRAM  COST 


3.  “GAO  C4ISR  first”  plan 

This  plan  modifies  the  baseline  to  develop 
C4ISR  tasks  before  all  others.  The  C4ISR  com¬ 
ponents  are  believed  to  pose  the  greatest  sched¬ 
ule  risks  to  PCS  development  due  to  their  scope 
and  complexity.  They  are  expected  to  require 
about  16  million  lines  of  software  code  (of  the 
34  million  total  estimated),  of  which  more  than 
half  will  be  new  code  (Welch,  2003).  This  huge 
undertaking  is  vulnerable  to  cost  and  schedule 
overruns.  By  investing  early  in  these  compo¬ 
nents,  subsequent  C4ISR  test  and  integration 
tasks  should  pose  less  risk  than  in  the  baseline. 

Key  distinctions  between  these  alternate 
plans  are  that  the  partial  orders  among  tasks 
may  change  between  plans  and  any  task  com¬ 
mon  to  all  of  the  plans  may  be  allocated  differ¬ 
ent  risk  levels  in  each.  For  instance,  "system 
integration  and  testing"  is  high-risk  in  the 
"baseline  plan"  because  immature  technologies 
must  be  concurrently  developed  and  inte¬ 
grated,  but  this  same  task  has  lower  risk  in  the 
"GAO  risk  first"  plan. 

The  three  alternate  plans  displayed  in  the 
Appendix  use  nominal  (i.e.,  unclassified,  non¬ 
proprietary)  FCS  task  data  provided  by  the 
Cost  Analysis  Improvement  Group,  Program 
Analysis  and  Evaluation  (PAE),  Office  of  the 
Secretary  of  Defense. 

TIME  FIDELITY 

Monthly  time  fidelity  suffices  for  purposes 
of  long-term  planning  and  budgeting,  although 
it  is  also  customary  to  offer  annual  budget  ac¬ 
counting  for  such  plans  and  perhaps  to  conduct 
annual  reviews  of  task  progress.  Indeed,  armual 
task  reviews  are  the  most  substantive  control 
points  in  such  projects,  given  that  they  are  tied 
to  annual  budget  authorizations.  Accordingly, 
we  plan  all  activities  and  events  in  months,  but 
make  armual  task-state  reviews  with  possible 
consequences  on  task  duration  and  time. 

EVALUATE  EACH  “PROJECT 
DESIGN”  FOUR  WAYS 

We  were  asked  to  analyze  the  ECS  baseline 
plan  and  the  two  GAO  alternatives.  The  follow¬ 


ing  is  essentially  a  series  of  project  reports  as 
we  went  back  to  our  PAE  sponsor  with  inter¬ 
mediate  results,  seeking  guidance  for  the  next 
steps  to  try.  We  do  not  recount  a  lot  of  ideas 
that  did  not  work.  Overall,  we  spent  8  person- 
weeks  with  PAE,  and  24  person-weeks  finding 
out  what  works,  and  what  doesn't.  Remember: 
the  goal  here  is  discovering  new,  effective  ways  to 
improve  cost  estimation  for  this  huge,  complex 
project,  not  manage  it. 

Eirst,  we  just  find  the  deterministic  project 
duration  (i.e.,  the  "shortest  longest  path  length" 
in  time,  or  simply  the  "critical  path  length."). 
This  is  easy,  and  exercises  our  newly-com¬ 
pleted  scenario  data  sets.  We  are  still  debug¬ 
ging  and  scrubbing  data. 

Then,  we  ignore  costs  and  budgets,  but 
assert  probability  distributions  for  task  dura¬ 
tions  and  apply  Monte  Carlo  simulation  to 
evaluate  the  critical  path  induced  from  each 
sampled  project  instance.  The  statistics  we 
gather,  and  experience  we  gain,  helps  us  un¬ 
derstand  the  behavior  of  each  project  design, 
especially  the  partial  orders  among  tasks. 

Next,  we  provide  a  list  of  total  project  du¬ 
rations  in  years  and  a  total  program  budget  for 
achieving  each  of  these  durations.  We  specify 
the  year-by-year  spending  goal  of  any  selected 
project  duration.  Each  task  can  be  started  only 
when  all  its  predecessors  in  the  project  design 
have  been  completed.  Each  task  can  be  started 
for  any  of  a  range  of  durations  in  months,  and 
each  of  these  durations  has  a  monthly  cost  pro¬ 
file.  Once  a  task  is  started,  it  cannot  be  inter¬ 
rupted.  Flowever,  a  task  start  can  be  delayed 
for  lack  of  available  budget(s)  sufficient  to  sup¬ 
port  its  chosen,  uninterrupted  duration  once 
started.  We  optimize  this  deterministic,  cost- 
constrained  project  schedule  to  minimize  total 
project  duration. 

We  note  that  "costs"  need  not  be  strictly 
expressed  in  constant-dollar  allocations,  but 
can  include  policy  penalties  rewarding  desir¬ 
able  outcomes  (i.e.,  finishing  earlier),  or  penal¬ 
izing  bad  ones  (i.e.,  finishing  very  late).  But, 
although  completion  time  is  a  concern,  the 
over-arching  constraint  will  be  total  obligation 
authority  (i.e.,  money)  committed  to  the  pro¬ 
gram. 

Einally,  we  nest  our  cost-constrained 
project  schedule  optimization  within  an  annual 
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state  review  simulation  of  each  active  task  (i.e., 
task  in  progress  at  time  of  review).  Af  each 
annual  review,  each  acfive  fask  may  be  delayed 
depending  on  a  probabilify  disfribufion  fhaf 
depends  on  fhe  risk  of  fhaf  fask,  or  on  any  prior 
experience  with  any  other  task.  So,  year-by-year, 
we  conducf  an  armual  sfafe  review  of  all  fhe 
acfive  fasks,  fhen  reopfimize  fhe  remaining 
plarming  horizon.  This  fakes  a  lof  of  compufa- 
fion,  buf  fhe  insighfs  are  worfh  fhe  efforf. 


RELATED  RESEARCH 

Malcolm,  Roseboom,  Clark,  and  Fazar 
(1959)  infroduce  Program  Evaluafion  and  Re¬ 
view  Technique  and  Critical  Pafh  Mefhod 
(PERT-CPM)  developed  for  fhe  Polaris  fleef 
ballistic  missile  program,  and  Kelly  (1961,  Kelly 
1963)  provides  a  mafhemafical  foundation.  Wi- 
esf  (1964)  highlighfs  two  key  shorfcomings  in 
CPM  af  ifs  nascenf  sfage:  if  only  considers  con- 
sfanf  fask  durafions  and  does  nof  recognize 
resource  consfrainfs. 

More  recenf  concepfs  of  CPM  allow  for 
greafer  flexibilify  in  fhese  areas,  for  example  by 
allowing  fasks  fo  be  scheduled  in  eifher  "regu¬ 
lar  time"  (wifh  nominal  cosfs)  or  in  "crash 
time"  (wifh  higher  cosfs),  and  by  allowing  cosf 
consfrainfs.  Even  wifh  fhese  irmovafions  fhe 
concepf  of  a  "fask"  remains  unifary  in  nafure. 
Af  a  fixed  poinf  in  time  of  fhe  projecf,  fasks  fhaf 
are  underway  are  nof  subjecf  fo  decisions  fhaf 
affecf  fheir  remaining  fimes  until  completion. 

If  each  fask  durafion  is  random,  and  some 
deferminisfic  equivalenf  fime  is  used  in  CPM, 
esfimafes  of  projecf  durafion  are  generally  op¬ 
timistic  as  Pulkerson  (1962)  demonsfrafes  using 
discrefe  random  fask  durafions.  A  fask  nof  on  a 
critical  pafh  using  mean  durafions  may  be  on 
fhe  crifical  pafh  wifh  positive  probabilify  when 
ifs  durafion  is  freafed  as  a  random  variable. 
Dodin  (1984)  reporfs  upper  and  lower  bounds 
on  projecf  durafion  when  fask  durafions  are 
independenf  random  variables,  and  uses  fhe 
Cenfral  Limif  Theorem  fo  justify  freafrng  fhe 
projecf  durafion  as  approximafely  normally 
disfribufed.  While  fhis  assumption  offers  frac- 
fabilify,  fhe  longesf  random-lengfh  pafh  is  nei- 
fher  normally  disfribufed  in  fheory,  nor  in  prac¬ 
tice  (as  can  be  verified  by  simple  Monfe  Carlo 


simulation),  and  fhis  assumption  can  give  mis¬ 
leading  resulfs. 

Resource  consfrainfs  are  admiffed  by  Bow¬ 
man  (1958),  who  infroduces  linear  program¬ 
ming  for  CPM,  and  Senju  and  Toyoda  (1968) 
and  Prifsker,  Watters,  and  Wolfe  (1969)  sfafe 
infeger-linear  programs  representing  discrefe 
decisions.  Demeulemeesfer  and  Herroelen 
(2002)  presenf  formulations  of  resource-con- 
sfrained  projecf  scheduling  problems  and  re¬ 
view  solution  mefhods. 

Using  linear  and  infeger  linear  programs  fo 
represenf  sfochasfic  models  has  a  long  hisfory. 
Babbar,  Tintner,  and  Heady  (1955),  Tinfner 
(1955,  Tintner  1960),  and  Sengupta,  Tintner, 
and  Morrison  (1963)  show  how  to  embed  opti¬ 
mization  within  Monte  Carlo  simulation.  Task 
duration  may  be  treated  as  a  random  variable 
with  a  distribution  not  completely  known  (Her¬ 
roelen,  Reyck,  and  Demeulemeester,  1998).  Pac- 
tors  influencing  fhese  random  variables  include 
resource  availabilify,  scheduling  of  deliveries, 
modification  of  due  dafes,  and  changes  in 
projecf  scope  fhaf  mighf  imply  fhe  cancellafion 
or  addifion  of  fufure  fasks  (Herroelen  and  Leus, 
2004). 

Generally,  fhe  increased  realism  of  sfochas¬ 
fic  PERT-CPM  modeling  comes  af  fhe  price  of 
increased  analytic  abstraction  and  computa¬ 
tional  cost.  Deterministic  equivalent  objectives, 
such  as  the  expected  project  critical  path  length 
or  expected  costs  that  include  penalties  for  vi- 
olafing  consfrainfs  (Gutjahr,  Sfauss,  and  Wag¬ 
ner,  2000),  may  be  easy  enough  fo  sfafe  and 
solve,  buf  fhe  risk  of  such  solufions  is  much 
more  difficulf  fo  gauge,  even  given  generous 
independence  assumptions. 

If  fask  durafion  is  random  and  nof  inde¬ 
pendenf  of  ofher  fask  durafions,  fhe  disfribu¬ 
fion  of  fhe  fofal  projecf  durafion  is  difficulf  fo 
characferize  (Yang,  Geunes,  and  O'Brien,  2001). 
An  independence  assumpfion  is  often  made  fo 
render  fracfable  analysis,  buf  fhis  assumpfion  is 
nof  realisfic.  An  optimal  deferminisfic  schedule 
f5q)ically  has  insuftidenf  slack  fo  remain  opfi- 
mal  (or  even  feasible)  in  an  uncerfain  seffing, 
and  fhus  lacks  robusfness  (Herroelen,  2004).  A 
frivial  example  wifh  fwo  idenfical,  parallel 
fasks,  each  wifh  random  duration,  reveals  this 
property. 
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In  addition,  managers  want  the  flexibility 
to  change  their  scheduling  decisions  as  the 
project  evolves.  Full  dynamic  scheduling  offers 
decision  poinfs  af  fask  complefions  (Igelmund 
and  Radermacher,  1983). 

We  need  resource  (essentially  budgef)  con- 
sfrainfs  and  we  cannof  ignore  uncerfainfy.  Of 
all  fhese  historical  confribufions,  we  admire 
Tintner's  works  mosf  for  fheir  originalify,  ele¬ 
gance,  and  simplicify,  and  we  follow  his  advice: 
for  fhe  sfochasfic  modeling,  use  Monfe  Carlo 
identify  simulation,  and  fhen  use  optimization 
for  each  random  realization. 

Finally,  we  do  assume,  as  does  PERT-CPM, 
fhaf  each  fask  is  separable  and  disfincf  from  all 
ofhers.  In  our  case,  fhese  fasks  are  subconfracfs, 
so  fhis  is  frue  in  law  as  well  as  in  facf:  If  you 
wanf  fo  re-define  fasks,  you  musf  re-negofiafe 
confracfs. 


FIND  SHORTEST  PROJECT 
COMPLETION  DATE  FOR  EACH 
ALTERNATE  PLAN  WITH  NO 
BUDGET  CONSTRAINT 

To  check  our  alfernafe  projecf  plans  fo  see  if 
we  gef  schedules  fhaf  make  sense,  we  ignore 
budgef  consfrainfs  and  jusf  solve  a  determinis¬ 
tic  CPM  problem. 

Given  a  projecf  nefwork  wifh  fixed  fask 
durafions,  we  wrofe  a  Java  (Sun  Microsysfems, 
2005)  procedure  for  an  unconsfrained  reaching 
algorifhm  fo  search  fhe  projecf  fasks  over  fheir 
adjacencies  in  partial  order  fo  find  fhe  comple¬ 
tion  time  of  fhe  projecf.  The  complefion  fime  is 
fhe  lengfh  of  a  longesf  pafh  from  projecf  sfarf  fo 
finish.  This  is  one  of  fhe  simplesf  nefwork  al- 
gorifhms  (e.g.,  see  fopological  sorting  and 
reaching  in  Ahuja  ef  al.,  1993,  pp.  107-108), 
wifh  worsf-case  runtime  linear  in  fhe  number 
of  parfial  orders. 

From  a  projecf  sfarf  in  January  2003,  fhis 
primifive  deferminisfic  analysis  yields  an  earli- 
esf  projecf  complefion  dafe  of  Ocfober  2012,  for 
fhe  "FCS  baseline  plan."  The  Army  wanfs  fo 
field  ifs  firsf  unif  in  Sepfember  2012,  so  fhis  is 
reassuring. 

Given  fhaf  we  can  solve  each  of  fhese  de¬ 
ferminisfic  problems  in  less  fhan  a  millisecond. 


we  suggesfed  solving  fhousands  of  fhese  prob¬ 
lems  in  a  Monfe  Garlo  simulafion  fo  assess 
sfochasfic  elemenfs  of  each  projecf  alfemafive. 
PAE  agreed. 


MONTE-CARLO  SIMULATE  TASK 
DURATIONS  FOR  EACH  ALTERNATE 
PLAN  WITH  NO  BUDGET 
CONSTRAINT 

The  fhree-paramefer  Weibull  disfribufion  is 
offen  used  fo  model  fhe  durafion  of  develop- 
menfal  fasks  for  cosf  esfimafion  and  planning. 
Law  and  Kelfon  (2000,  p.  376)  explain  fhe  rea¬ 
soning  for  fhe  use  of  fhis  disfribufion.  The 
Weibull  reliabilify  function: 

R{x-  a,  j3,  y)  =  e  \  a  )  ,x>y 

is  complefely  characferized  by  ifs  fhree  non- 
negafive  paramefers.  An  absolufe  minimum 
fask  durafion  is  given  by  y.  Eor  jS  >  1,  fhe 
Weibull  densify  has  a  mode  sfricfly  greater 
fhan  y,  and  fhis  mode  appeals  managerially  as 
fhe  fask  durafion  of  maximum  likelihood.  The 
Weibull  also  feafures  more  and  larger  devia¬ 
tions  from  fhe  mode  in  fhe  positive  direcfion. 

Miller  (2003)  offers  a  convenienf  procedure 
for  specifying  fhe  paramefers  of  a  fhree-param¬ 
efer  Weibull  disfribufion  from  infuifive  proper¬ 
ties  of  fask  durafion.  We  need  a  value  for  fhe 
durafion  mode,  (for  fhis,  we  jusf  use  fhe 
longesf  admissible  fask  durafion)  and  a  cafego- 
rizafion  of  fhe  risk  level  as  high,  medium,  or 
low.  Miller  suggesfs  high  risk  for  unprece- 
denfed  fasks,  medium  for  developmenf  and 
some  new  integration  fasks,  and  low  for  rou- 
fine,  repefifive,  or  well-understood  fasks.  Each 
risk  level  is  associafed  wifh  fixed  values  of  two 
affribufes  of  fhe  fask  durafion  fhaf  fogefher 
wifh  wifh  fhe  mode  Xj^  are  sufficienf  fo  deter¬ 
mine  all  fhree  paramefers  of  fhe  Weibull.  Af- 
fribufe  =  ^m/  7  is  the  ratio  of  fhe  mode  fo 
fhe  minimum  durafion  and  ^  >  ^m)  is 

fhe  probabilify  fhaf  fhe  durafion  exceeds  fhe 
mode.  Miller  suggesfs  for  (risk,  Rf^,  Pj^)  fhe 
values  (high,  1.25,  0.8),  (medium,  1.20,  0.7),  or 
(tow,  1.15,  0.6).  PAE  concurs. 
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The  three-parameter  Weibull  distribution 
can  be  defined  using  either  triplet  (a,  /3,  y)  or 
{Rf^,  Xj^,  Pf^).  Table  1  shows  the  mapping  be¬ 
tween  these  equivalent  descriptions.  For  exam¬ 
ple,  a  medium-risk  task  with  most-likely  dura¬ 
tion  =  36  months  is  endowed  with  = 
1.20  and  =  0.7,  and  the  associated  Weibull 
parameters  are: 

36(1  -  1/1.20) 

“  “  [-ln(0.7)]i+'"»-">  “ 

1  36 

^  “  1  -H  ln(0.7)  “  ~  ~ 

In  consultation  with  PAE,  we  truncate  our 
Weibull  at  its  90‘*^  percentile  to  avoid  unrealis- 
tically-long  project  durations.  The  maximum 
allowable  duration  truncation  point  is  calcu¬ 
lated  =  y  +  a[-ln(0.1)]^^'^.  Such  a  Weibull 
is  trivial  to  generate  from  a  unif-uniform  vari- 
afe  U  via  X  =  y  4-  a[— ln(l  —  .9U)]^^^. 

We  compare  fhe  fhree  ECS  projecf  plans 
(baseline,  GAO  risk  firsf,  and  GAO  G4ISR  firsf) 
ignoring  cosf  consfrainfs.  Eor  each  simulafed 
iferafion,  new  fask  durations  are  sampled  from 
fheir  Weibull  probabilify  disfribufions  and  fhe 
resulfing  projecf  complefion  fime  is  recorded. 
The  simulation  is  repealed  for  60,000  iferafions 
(i.e.,  we  commif  abouf  a  minufe  of  computing 
fime  fo  each  case).  We  fhus  induce  fhe  random 
disfribufion  of  projecf  complefion  fime  for  each 
projecf  plan.  Resulfs  from  fhese  simulations  ap¬ 
pear  in  Eigure  1. 


Table  1.  Association  between  attributes  and 
parameters  of  the  three-parameter  Weibull 
distribution  show  how  to  map  from  attributes  to 
Weibull  parameters  or  vice  versa. 


Attributes 

Parameters 

a 

*m(1  “  1/Rm) 

/ 

1 

Xm  =  y  +  o;h  -  pj 

^  ■  1  +  In(PM) 

Pm  = 

Xm 

OPTIMIZE  A  BUDGET-CONSTRAINED 
DETERMINISTIC  SCHEDULE 

Our  real-world  project  has  a  budget  and 
costs  that  may  be  influenced  by  fhe  rafe  af 
which  we  work  fo  finish  fasks.  We  adopf 
monfhly  plarming  fidelify.  Eor  each  fask,  we 
infroduce  a  sef  of  discretionary  fask  durafions 
where  each  durafion  has  ifs  own  monfh-by- 
monfh  cosf  profile  for  completing  fhe  fask.  Our 
fofal  projecf  budgef  depends  on  fhe  finish  year 
we  choose,  where  each  candidafe  finish  year 
induces  a  complefely  independenf  sef  of  year- 
by-year  budgef  guidelines.  These  generaliza¬ 
tions  suggesf  an  opfimizafion  model  fo  identify 
fhe  leasf  expensive  feasible  projecf  complefion 
fime.  We  discrefize  fhe  sfarfing  limes  for  fasks 
and  fask  durafions  fo  monfhs,  and  fo  use  fhe 
following  infeger  linear  program  fo  suggesf  a 
projecf  schedule: 


Index  Use  [-cardinality] 


y&Y 

Eiscal  year  (alias  yh,  yf) 
[~20] 

i  G  I 

Task  (alias  j)  [~200] 

6  G  I 

Distinguished,  last  task 
in  project 

Pairwise  partial  order: 
task  i  must  be  completed 
before  fask  j  sfarfs 

m  G  M 

Plarming  monfh  [—240] 

m  G  M  (y) 

Monfh  in  fiscal  year  y 

s  =  s,-  G  Si  C  M 

Sfarf  monfh  for  fask  i 

d  =  diG  Di 

Task  i  durafion  in 
monfhs 

1  <  Pi  <  di 

Monfhs  since  sfarf  of 
ongoing  fask  i 

Given  Data  [units] 

budgety  yjr,  hudgety  yf  Lower  and  upper  cosf 
range  during  fiscal 
year  y  if  program 
finishes  in  fiscal  year 
yf  [cosf] 

cost^^^y  Cosf  of  ongoing  fask  i 
wifh  durafion  d 


Page  46 


Military  Operations  Research,  Vll  N4  2006 


ESTIMATING  TOTAL  PROGRAM  COST 


Distribution  of  Project  Completion  Times 


Figure  1.  Sixty-thousand  samples  of  each  alternate  project  plan  are  depicted.  There  are  no  cost  constraints  and 
each  task  duration  is  generated  independently  from  a  Weibull  distribution  reflecting  its  risk  in  that  plan.  "GAO 
risk  first"  is  the  most  desirable  plan  with  the  highest  probability  of  an  early  completion  time,  while  the  baseline 
plan  has  the  lowest  probability  of  successful  completion  at  any  given  time. 


during  elapsed  month 
p  [cost] 

pen_under,  pen_over  Cost  per  unit  of 

cumulative  budget 
range  violation 
[months /cost] 


Decision  Variables  [units] 


X 


isd 


UNDER,„SLACK^,OVER^ 

y  y  y 


=  1  if  fask  i  is 
sfarted  in  monfh 
s  wifh  duration 
d,  0  otherwise 
[binary]. 

=  1  if  finish 
year  of  program 
is  year  yf,  0 
ofherwise 
[binary]. 

When  we 
compare 
expenditures 
through  fiscal 
year  y  with 
desired  lower 
and  upper 
ranges  on  total 
budgets,  these 
variables 
respectively 


measure  lower- 
range  violation, 
unspent  funds 
below  upper- 
range,  or  upper- 
range  violation 
[months /cost]. 


Formulation 

MIN  E  (s  +  d-l)X,,, 

UNDER, iiScK, OVER 

+  X  {pen_underUNDERy  +  pen_overOVERy) 

yEY 

(Fl) 

s.t.  X  X,,>1  ViGJ 

s  Dj  AS —  1^||M|| 

(F2) 

^tsd  —  Qyf  ^  J//  C  Y,s  e  Si,d  G  D(AS  +  d 

-lGM(t//)  (F3) 

E  Qy/^1  (F4) 
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S  id{m—s  +  l)^isd) 

yh<y ,mE.M{  yh),iGl,sESi,dEDi 
A/ji  — s  +  l>lAm— s  +  l<dAS+d  — 1<||M|| 

+  UNDERy  +  SLACXy  -  OVER^ 

=  E  ibudgetj,^_yf)Qyf  V 1/  G  Y  (F5) 

yf BY  Ay  fry 

SLACKy  <  E  (budgetyh^yf 
y^'-y/ 
y/ey^y/ay 

-  budget y,,^yf)Qyf  V  1/  G  Y  (F6) 

E  X,,, 

s  E  Si,dBDiAS  +  d-l<Sj 

>  Xy,.,,  V  (i,  j)  G  A,  Sj  G  Sy,  dy  G  Dj 
ASj  +  -  1  <  ||M||ASy  >  MIN  (s  +  d  -  1) 

sGSirfGDi 

(F7) 

Xi,rf  G  {0,  1}  V  i  G  7,  s  G  S„  d  G  D,- 

(F8) 

Q,^G{0,  1}  Vi// GY  (F9) 
UNDERy  >  0, SLACKy  >  0,  OVFRy 

>0  Vj/GY  (FIO) 

Verbal  Description 

The  overarching  goal  is  to  decide  how  long 
the  project  should  take  to  complete.  The  objec¬ 
tive  function  (FI)  expresses  total  planned 
project  duration  in  months,  plus  an  elastic  pen¬ 
alty  term  for  any  violation  of  cumulative  bud¬ 
get  ranges  over  the  planning  horizon.  Each  par¬ 
tition  constraint  (F2)  requires  that  exactly  one 
start  month  and  duration  be  selected  for  each 
task.  Each  constraint  (F3)  permits  the  last 
project  task  to  be  completed  in  a  fiscal  year  only 
if  that  fiscal  year  has  been  selected  for  project 
completion.  Constraint  (F4)  requires  that  ex¬ 
actly  one  project  completion  year  be  selected. 
Each  constraint  (F5)  accumulates  expenditures 
from  the  first  fiscal  year  through  a  current  fiscal 
year  and  determines  whether  the  cumulative 
budget  ranges  have  been  satisfied,  or  violated. 
(This  cumulant  form  is  amenable  to  both  a  lin¬ 
ear  programming  solver  and  to  managerial  in¬ 


terpretation:  Brown  et  al.,  1997.)  Each  con¬ 
straint  (F6)  limits  cumulative  slack  budget  by 
the  hard  constraints  on  yearly  program  budget 
determined  by  finish  year.  Each  constraint  (F7) 
ensures,  for  a  pair  of  tasks  adjacent  in  prece¬ 
dence,  that  the  predecessor  task  must  be  com¬ 
pleted  before  the  successor  task  can  start.  Vari¬ 
able  domains  are  defined  by  (F8-F10).  (F8)  can 
restrict  admissible  start  months  for  each  task 
and  the  admissible  durations  of  each  task. 

TASK  DURATIONS  AND  COSTS 

Eor  a  task  started  in  month  s  for  duration  d 
months,  we  can  assert  any  month-by-month 
cost  distribution  we  want,  even  including  costs 
for  months  preceding  task  start  or  following 
task  completion  (as  military  research  and  de¬ 
velopment  often  requires:  Brown  et  al.,  2004). 
Flere  (following  explicit  guidance  from  PAE), 
we  simplify:  no  matter  when  a  task  might  start 
for  a  d-month  duration,  we  allocate  its  Task- 
jOostj  over  each  month  of  this  duration  with  a 
Rayleigh  distribution  truncated  at  its  97-th  per¬ 
centile,  so  that  its  cost  in  month  p  would  be: 

MonthjCosty  =  [Task_Costa/0.97][e\pi{{p 

-  l)dn(0.03)}/d^)  —  exp({pdn(0.03)}/d^)]. 

EACH  PDSSIBLE  COMPLETION 
YEAR  HAS  ITS  OWN  BUDGET 

The  key  policy  question  is  (always)  "how 
much  are  we  willing  to  spend  and  when  are  we 
willing  to  spend  it  to  finish  our  project  (e.g.,  by 
the  end  of  any  given  future  fiscal  year)?"  Are 
we  willing  to  spend  more  for  a  quicker  comple¬ 
tion?  Are  there  competing  projects  that  restrict 
our  plarmed  spending  pattern?  Eor  plarming 
purposes,  sooner  or  later  we  have  to  at  least 
estimate  upper  and  lower  limits  on  the  overall 
plarmed  project  budget  for  each  financial  year 
of  each  plarmed  project  duration.  Flere,  for  any 
candidate  project  completion  year  and  budget, 
we  also  use  a  Rayleigh  distribution  to  distribute 
this  budget  year-by-year. 

A  complex,  long-term  military  project 
rarely  meets  all  its  plarmed  budget  targets. 
Sometimes  allocated  funds  are  available  before 
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they  can  be  used  and  sometimes  costs  exceed 
projections.  Accordingly,  we  accumulate  any 
year-by-year  over-expenditure  or  under-expen¬ 
diture,  but  penalize  any  such  cumulative  viola¬ 
tion  year-by-year  until  the  surplus  or  deficit  is 
repaired.  The  idea  (Brown  et  al.,  2004)  is  to 
allow  some  reasonable  flexibility  in  program 
management,  while  showing  good  faith  adher¬ 
ing  to  overall  project  budget  guidance. 

FCS  ANNUAL  BUDGETS 

An  FCS  project  budget  estimate  has  been 
developed  with  help  from  PAE.  Separafe  esfi- 
mafes  musf  be  prepared  for  each  feasible 
projecf  durafion,  ranging  from  FY2010  fo 
FY2016.  Table  2  shows  fhe  minimum,  planned 
and  maximum  annual  budgefs  for  a  FY2011 
completion  fhaf  has  been  Rayleigh-allocafed 
over  the  planning  years. 

Preparing  budgets  for  each  complefion 
year,  we  fry  fo  follow  fhe  besf  guidance  avail¬ 
able.  For  example,  a  GAO  review  of  FCS  (Fran¬ 
cis,  2004)  concludes  fhaf  a  one-year  delay  in 
FCS  would  increase  cosfs  by  $4  billion  fo  $5 
billion  (during  fhe  sysfem  developmenf  and 
demonsfrafion,  and  producfion  phases).  Rela¬ 
tive  fo  fhe  fofal  projecfed  cosf  of  FCS,  fhis  rep- 
resenfs  a  0.5%  cosf  overrun  per  year  of  delay. 
Conversely,  Lee  (1997)  esfimafes  for  projecfs  in 
general  fhaf  accelerafing  fhe  pace  of  work  and 


decreasing  a  projecf  durafion  by  one  year 
would  require  an  increased  budgef  of  0.2%.  Of 
course,  delays  in  any  accelerafed  plan  subjecf  if 
fo  cosf  overruns  as  well. 


SUPERIMPOSE  MONTE  CARLO 
SIMULATION  OF  ANNUAL  TASK 
REVIEWS  (WITH  POSSIBLE  TASK 
DELAYS  AND  COST  CHANGES)  ON 
SCHEDULE  OPTIMIZATION 

We  nesf  our  cosf-consfrained  projecf  sched¬ 
ule  optimization  wifhin  a  simulafed  annual 
"projecf  review"  of  each  fhen-acfive  fask.  Each 
reviewed  active  fask  may  be  delayed  depend¬ 
ing  on  a  probabilify  disfribufion  fhaf  depends 
on  fhe  risk  of  fhaf  fask,  or  on  any  prior  experience 
with  any  other  task.  The  cosf  of  each  reviewed 
fask  may  also  change,  as  can  fhe  forecasf  cosf  or 
durafion  of  any  fufure  fask.  Each  annual  projecf 
review  is  followed  by  a  re-opfimizafion  of  fhe 
remaining  fufure  planning  horizon.  Year-by¬ 
year,  we  conducf  an  annual  projecf  review,  re- 
opfimize,  and  so  forfh.  Figure  2  illusfrafes  how 
fhis  simulation  mighf  progress. 

In  our  simple  example,  each  active  fask 
reviewed  is  delayed  wifh  (risk,  probabilify,  and 
delay)  of  (high,  0.5, 140%);  (medium,  0.3, 120%); 
or  (low,  0.2,  110%),  and  a  delayed  fask's  cosfs 


Table  2.  For  a  project  completion  in  FY2011,  a  nominal  total  FCS  system  development  and  demonstration 
budget  of  20.04  billion  2004  dollars  has  been  Rayleigh-allocated  by  fiscal  year.  These  planned  annual 
budgets  are  goals,  but  the  minimum  (20%)  and  maximum  (105%)  budget  ranges  are  hard  constraints.  The 
sums  of  annual  expenditures  from  FY2003  through  any  given  year  are  constrained  by  these  cumulative  hard 
constraints.  Within  these  hard  cumulative  limits,  any  cumulative  expenditure  under-  or  over-plan  is 
penalized  and  carried  forward  to  the  next  year,  where  it  will  be  penalized  again  if  not  mitigated. 


Year 

Minimum  Budget  ($  Million) 

Planned  Budget  ($  Million) 

Maximum  Budget  ($  Million) 

FY2003 

$  175 

$  875 

$  919 

FY2004 

482 

2,410 

2,530 

FY2005 

676 

3,382 

3,551 

FY2006 

732 

3,658 

3,841 

FY2007 

667 

3,335 

3,502 

FY2008 

530 

2,652 

2,785 

FY2009 

374 

1,871 

1,965 

FY2010 

237 

1,183 

1,242 

FY2011 

135 

674 

708 

TOTAL 

$4,008 

$20,040 

$21,042 
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Figure  2.  Each  annual  review  (depicted  top-to-bottom  separating  the  shaded  and  un-shaded  portions  of  each 
timeline  row)  may  delay  any  currently-active  task  (i.e.,  any  highlighted  task  sparming  shaded  and  un-shaded 
timelines),  or  change  its  cost.  After  each  annual  review,  the  remaining  schedule  is  re-optimized  with  monthly 
fidelity,  subject  to  annual  budget  goals  induced  by  the  best  project  duration  still  achievable.  The  optimization 
must  complete  currently-active  tasks  as  specified  by  the  latest  annual  review,  but  can  choose  any  admissible 
start  month  for  any  future  task  and  choose  any  future  admissible  task  duration  it  pleases,  as  long  as  the 
associated  costs  of  the  chosen  duration  are  bearable.  Directed  arcs  between  partially-ordered  task  pairs  and 
nominal  Rayleigh-distributed  task  budgets  are  shown  to  illustrate  how  the  optimization  must  schedule  tasks 
such  that  total  expenditures  follow  aimual  budget  guidance. 


increase  with  (risk,  probability,  change)  of 
(high,  0.5,  150%),  (medium  0.3,  130%),  or  (low, 
0.2,  110%).  As  a  practical  matter,  we  permit  a 
task  to  be  delayed  to,  at  most,  twice  its  original 
duration  (longer  than  this  and  the  task  would 
likely  be  cancelled,  and  the  project  redesigned). 

If  an  armual  review  exfends  fhe  remaining 
opfimized  projecf  durafion,  fhe  fofal  projecf 
budgef  changes  accordingly  (here,  if  is  in¬ 
creased  in  proportion  fo  fhe  lengfh  of  fhe  ex- 
fended  durafion,  fhough  any  adjusfmenf  is  ad¬ 
missible). 

This  amalgam  of  armual  budgef  review 
simulafion  and  opfimizafion  of  fhe  remaining 
plarming  horizon  offers  a  face-valid  emulation 
of  acfual  pracfice,  and  our  Monfe  Carlo  armual 
simulafion  can  easily  be  replaced  wifh  a  human 
umpire  if  more  experf  confrol  and  judgmenf 


appeal.  We  have  fesfed  dependenf  models  for 
inflating  cosfs  and  fask  durations,  and  fwo  key 
lessons  emerge:  even  mildly  infer-fask  depen¬ 
denf  delays  cause  havoc,  and  any  projecf  over¬ 
seer  would  infervene  long  before  fhese  resulfs 
played  ouf.  Alfhough  we  could  model  decreases 
in  fask  durafion  and/or  cosf,  fhis  prospecf  has 
never  come  up  wifh  PAE,  nor  have  we  ever 
observed  such  a  signal  even!  in  our  careers. 

IMPLEMENTING  THE  OPTIMIZATION 
MODELS 

The  alfemafe  projecf  plans  have  been  sef  up 
in  Microsoft  Project  (2004).  We  want  to  use  the 
graphical  user  interface  offered  by  Projecf,  as  well 
as  ifs  infegrafion  wifh  fhe  MS  Office  Suife.  Our 
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optimization  (with  optional  Monte  Carlo  annual 
reviews)  is  been  implemented  in  the  algebraic 
modeling  language  GAMS  (Brook  et  al.,  1998). 

Each  scenario  is  presented  to  GAMS  as  two 
input  scripts,  one  for  tasks,  and  the  other  for 
budgefs.  The  former  scripf  has  a  descriptor  for 
each  fask  specifying  each  candidafe  sfarf 
monfh,  duration  in  monfhs,  and  cosf.  Nobody 
will  use  an  optimization  model  fhey  can'!  con- 
frol,  so  fhis  scripf  (via  fhe  Projecf  inferface)  lefs 
a  planner  complefely  confrol  alternatives,  in¬ 
cluding  "sfarf  fhis  fask  in  fhis  monfh  for  fhis 
durafion  af  fhis  cosf." 

As  you  would  expecf,  fhe  GAMS  scripf  im¬ 
ports  a  scenario  from  Projecf,  solves  if,  and  re- 
fums  fhe  solution  for  display  and  analysis.  Buf, 
fhe  majorify  of  our  GAMS  scripf  is  devoted  to 
diagnosis  and  exigenf  reporf  wrifing,  to  better 
monitor  fhe  behavior  of  our  experimenfal  mod¬ 
els. 

For  insfance,  early  experience  wifh  our 
model  revealed  fhaf  alfhough  we  offer  precise 
confrols  for  fask  sfarf  fimes  and  durafions,  no¬ 
body  used  fhese:  by  defaulf,  each  fask  can  sfarf 
any  fime  for  any  admissible  durafion.  As  a 
consequence,  an  enormous  number  of  alfemafe 
fask  sfarf  variables  was  generafed.  Solvers  me¬ 
chanically  defecf  and  remove  redimdanf  model 
feafures.  However,  such  "presolve"  feafures  do 
nof  fell  you  whaf  fhey  have  removed,  or  why. 
And,  presolve  will  nof  idenfify  all  redundan¬ 
cies:  each  reduction  involves  no  more  fhan  re¬ 
moving  one  redundanf  variable  wifh  an  equa¬ 
tion  subsfifufion.  You  can'f  be  sure  you  have 
removed  fhe  redundancies  you  worry  abouf 
unless  you  filler  fhem  ouf  yourself. 

So,  in  addifion  fo  fhe  index  domain  tittering 
fhaf  duffers  fhe  summafions  in  our  formulafion 
(buf  makes  our  infenf  clear),  we  formulated  an 
auxiliary,  frivial  opfimizafion  (nof  displayed)  fo 
find  fhe  admissible  sfarf  fimes  and  durafions 
for  each  fask. 

We  work  on  our  formulafion  and  model 
generafor  until  presolve  finds  as  little  as  possi¬ 
ble  left  fo  remove.  After  such  filtering,  a  f5q)ical 
scenario  consisfs  of  abouf  53  fhousand  con- 
sfrainfs,  and  19  fhousand  variables,  almosf  all 
binary.  We  would  expecf  such  an  integer  linear 
program  fo  solve  on  a  laptop  in  minufes. 

We  used  GPLEX  9.0  (ILOG,  2004).  Defaulf 
CPLEX  sfalled,  and  could  nof  find  an  inifial 


feasible  infeger  solution.  We  provided  an  ad¬ 
missible  infeger  sfarfing  poinf  from  our  frivial 
presolve.  GPLEX  bogged  down  in  problem  pre¬ 
processing  and  infeger  cuf  generation.  Evenfu- 
ally,  fo  gef  GPLEX  fo  work,  we  had  do  disable 
mosf  of  ifs  defaulf  opfions  for  cuf  generafion 
and  roof  node  heurisfics. 

Our  solve  fimes  are  still  longer  fhan  we 
expected.  If  we  fix  projecf  durafion  and  budgef, 
fhe  resulting  opfimizafion  model  is  easier  fo 
solve  (and  we  can  aufomafe  fhis  fixing  in 
GAMS  for  each  projecf  durafion  we  fancy). 
However,  even  fhis  simplifying  resfricfion 
leaves  us  wifh  a  daimfing  scheduling  problem: 
fo  choose  a  sfarf  fime  and  durafion  for  each  fask 
fhaf  satisfies  every  parfial  order  between  fasks, 
maximally  complies  wifh  fhe  cumulative  bud¬ 
gef  guidance,  and  also  finishes  on  fime.  Typi¬ 
cally,  if  fakes  us  3  GHz-hours  fo  resolve  fo  a 
10%  infegralify  gap. 

These  infeger  linear  programs  may  be  hard 
fo  solve,  buf  fhey  convey  remarkable  insighf  we 
have  nof  gained  by  any  ofher  means.  ILP  mod¬ 
els  depend  on  well-defined  assumptions  and  of¬ 
fer  fidelify  fhaf  closely  mimics  real-world  plan¬ 
ning,  and  fhey  also  convey  an  objective 
assessmenf  of  solution  qualify  fhaf,  for  insfance, 
lefs  us  confidenfly  compare  alfemafe  scenarios. 

For  insfance,  fhe  objective  assessmenf  of 
solufion  qualify  we  gef  from  fhe  infeger  linear 
programs  is  invaluable  when  comparing  two 
competing  alternatives:  given  assumptions  sfafed 
clearly,  and  dafa  defined  commensurafely,  no 
matter  how  complex  fhe  projecf,  if  fhe  optimized 
solutions  exhibif  integrality  gaps  that  do  not  in¬ 
tersect,  we  can  confidently  declare  a  winner. 


RESULTS  AND  CONCLUSION 

A  Rayleigh-distributed  project  budget  just 
does  not  fit  the  needs  of  fhe  consfifuenf  FGS 
fasks  as  fhe  projecf  proceeds  for  any  alfemafe 
projecf  plan.  Accordingly,  we  sfafe  fhe  budgef 
as  a  cumulafive  goal  from  projecf  sfarf  in 
FY2003  fhrough  each  year,  wifh  any  cumulafive 
under-  or  over-expendifure  carried  forward  fo 
later  years,  charging  a  penally  for  any  deviation 
from  cumulafive  budgef  until  fhaf  violation  is 
rectified.  Wifhouf  fhis  flexibilify,  we  musf  ex¬ 
tend  fhe  projecf  finish  year  and  leave  Rayleigh- 
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allocated  funds  for  infermediafe  years  unused. 
For  long-ferm  planning,  fhis  makes  no  sense  af 
all.  Figure  3  shows  how  fhe  deferminisfic,  op¬ 
timized  plans  use  fhe  Rayleigh-disfribufed 
projecf  budgef,  and  displays  fhe  same  expendi- 
fures  in  cumulafive  ferms. 

Sfarfing  fhe  "baseline  plan"  in  January 
2003,  we  find  a  (cumulafive)  cosf-consfrained 
schedule  fhaf  finishes  jusf  as  quickly  as  primi¬ 
tive  CPM  wifh  no  cosf  consfrainfs  af  all:  Octo¬ 
ber  2012.  Our  nominal  fask  cosfs  and  fofal  bud¬ 
gef  resfricfions  just  suffice  wifhouf  delaying  fhe 
projecf:  fhis  is  anofher  reassuring  discovery. 
And,  our  suggested  cumulafive  expendifure 
history  follows  long-term  guidance  closely. 

When  we  simulafe  annual  reviews,  wifh 
fask  delays,  fhe  optimized  projecf  plans  fake  a 
lof  longer  to  complefe  (see  Figure  4).  Monfe 
Carlo  delays  of  fask  durafions  as  fhe  projecf 
proceeds  exfend  achievable  projecf  completion, 
so  fhe  projecfed  budgef  (discovered  year-by- 
year  as  fhe  projecf  progresses  and  fhese  delays 
arise)  is  characterized  by  fransifions  to  succes¬ 
sively  longer  finish-year  budgefs  (see  Figure  5). 

For  fhe  baseline  plan,  jusf  infroducing  ran¬ 
dom  Monfe  Carlo  fask  durafions  increases  fhe 
median  projecf  durafion  by  abouf  10%.  If  bud¬ 
gef  consfrainfs  are  imposed  in  addifion  fo  ran¬ 
dom  fask  delays,  estimated  projecf  durafion 
rises  by  abouf  39%.  For  FCS,  a  39%  delay  cor¬ 


responds  fo  approximafely  four  years,  where  a 
one-year  delay  has  been  estimated  by  fhe  GAO 
fo  add  between  $4  billion  and  $5  billion  fo  fhe 
fofal  acquisition  cosf. 

In  fhe  absence  of  budgef  consfrainfs,  mifi- 
gafing  fhe  fechnologies  below  fhe  required  ma- 
furify  level  prior  fo  ofher  fasks  (GAO  risk  firsf) 
leads  fo  projecf  complefion  faster  fhan  fhe  base¬ 
line  plan.  When  budgef  consfrainfs  are  added, 
fhis  plan  mainfains  ifs  advanfage  alfhough  if  is 
subjecf  fo  delays  similar  fo  fhe  baseline  plan. 

Table  3  assembles  FGS  projecf  durafion  es- 
fimafes  for  each  alternate  plan  and  from  each  of 
our  models.  Wifh  no  budgef  consfrainf,  if's  besf 
fo  mifigafe  high-risk  technology  firsf.  Wifh 
projecf  budgef  consfrainfs,  bofh  fhe  baseline 
and  risk-firsf  plans  are  attractive,  buf  wifh  an¬ 
nual  review  simulafion,  fhe  GAO  G4ISR  firsf 
plan  furns  ouf  fo  be  leasf  vulnerable  fo  delay. 
Given  fhe  high  risk  of  fhe  FGS  program,  we 
prefer  fhe  behavior  of  GAO  G4ISR  firsf. 

FGS  is  a  long,  complex,  technically  risky, 
expensive,  and  important  projecf.  Buf,  FGS  is  nof 
unique  in  fhese  respecfs:  fhere  are  (always) 
ofher  defense  projecfs  fhaf  are  comparable 
(Brown  ef  al.,  2004).  Based  on  our  plarming 
experience  wifh  such  projecfs,  we  recom¬ 
mend  a  high-level  assessmenf  such  as  fhaf 
presented  here  fo  forecasf  as  early  as  possible 
and  as  well  as  possible  where  fhe  fragilities 
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Figure  3.  A  Rayleigh-distributed  budget  for  a  FY2012  project  finish  is  shown  in  annual  and  cumulative  terms 
along  with  deterministic,  optimized  expenditures  for  each  alternate  project  plan.  The  budget  is  stated  as  a 
cumulative  goal  from  project  start  in  FY2003  through  each  year,  with  any  cumulative  under-  or  over-expendi¬ 
ture  carried  forward  to  later  years,  charging  a  penalty  for  any  deviation  from  cumulative  budget  goal  until  that 
violation  is  rectified.  Note  the  banking  of  unused  budget  (e.g.,  in  FY2007)  in  anticipation  of  borrowing  it  back 
(e.g.,  in  FY2010).  Without  this  flexibility,  we  must  extend  the  project  years  beyond  FY2012  and  leave  allocated 
funds  for  intermediate  years  unused.  For  long-term  planning,  this  makes  no  sense  at  all. 
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Expenditure  by  Plan 


Year  of  Review 


Figure  4.  Annual  expenditures  are  shown  for  optimized  FCS  project  schedules  with  a  simulated  annual  review 
of  each  then-active  task  that,  depending  on  task  risk,  may  randomly  induce  a  delay  and  a  cost  increase.  As 
expected,  project  completion  is  delayed  for  all  project  plans,  and  costs  rise  (by  about  four  years  and  $600  million, 
respectively).  The  idea  is  to  animate  how  these  task  delays  arise  over  time  and  how  they  cascade  and  influence 
other  competing  or  succeeding  tasks.  Note  that  GAO  C4ISR  finishes  two  years  before  the  other  plans. 


and  vulnerabilities  are  in  an  overall  project 
plan,  and  to  prescribe  work-arounds  sooner, 
rather  than  later. 


Effect  of  Annual  Review  on  Baseline  Plan  Budget 


Figure  5.  For  the  baseline  plan,  as  the  project 
progresses  year-by-year  and  is  subjected  to  aimual 
reviews  that  delay  then-active  tasks,  the  remaining 
project  tasks  are  reoptimized  and  the  project  takes 
longer  to  complete.  This  shifts  the  best  achievable 
project  budget  to  a  later  year.  The  display  shows 
when  the  optimization  must  jump  to  a  larger  and 
longer  budget. 


We  emphasize  key,  distinguishing,  real- 
world  advantages  offered  here.  These  compo¬ 
nent  models  are  easy  to  discuss,  illustrate,  brief, 
and  understand:  Project  scheduling  and  prim¬ 
itive  Monte  Carlo  simulation  are  ubiquitous. 
We  co-opt  the  graphical  user  interface  of  a 
project  management  system  and  its  data  base, 
and  embed  the  optimizer  and  Monte  Carlo  re¬ 
views,  thereby  producing  a  visually-appealing 
planning  product  at  a  low  per-seat  cost.  The  em¬ 
bedding  of  deterministic  optimization  within 
hme-phased  simulahon  decouples  the  two  in  a 
way  that  requires  few  simplifying  assumphons 
and  that  invites  very  basic,  intuitive  analysis  to 
evaluate  results.  We  closely  mimic  real-world  be¬ 
havior: 

•  each  optimization  decision  offers  to  start  a 
task  for  some  duration  on  some  cost  sched¬ 
ule,  and  this  corresponds  directly  to  contract 
terms  we  must  commit;  and 

•  simulated  annual  review  of  each  then-ac¬ 
tive  task  state  can  depend  on  any  prior 
learning,  but,  more  importantly,  this  de¬ 
pendence  can  be  described  in  simple,  intu¬ 
itive  terms  of  the  facts  already  in  hand  for 
the  review. 
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Table  3.  Deterministic  CPM  gives  a  lower  bound  for  each  plan  duration.  Monte  Carlo  CPM,  here  using  for 
each  task  an  independent  Weibull  task  time  based  only  on  that  task's  risk,  shows  the  delaying  influence  of 
task  time  variability  on  the  median  project  duration  for  60,000  samples  of  each  schedule  plan.  Deterministic 
optimized  plans  honor  project  budget  goals  and  show  the  delaying  influence  of  doing  so.  Optimized  plans 
with  Monte-Carlo  annual  reviews  show  the  combined  delaying  effects  of  task  time  variability  and  budget 
goals.  For  reference,  a  sfart  in  January  2003  for  118  months  yields  a  finish  in  October  2012. 


Estimated  PCS  Program  Durations  in  Months 


Schedule  Plan 

No  Budget  Constraint 

Project  Budget  Constraint  by 

Fiscal  Year  Completed,  and 
Allocated  Yearly 

Deterministic  CPM 

Monte  Carlo  CPM 

Deterministic 

Optimized 

Optimized  with 
Monte  Carlo 
Annual 
Reviews 

Baseline 

118 

150 

118 

164 

GAO  Risk  First 

116 

126 

116 

162 

GAO  C41SR  First 

129 

139 

130 

145 

EPILOG 

dally  Mr.  Walter  Cooper, 

for  their  continued 

Time  will  tell  whether  our  work  proves 
prescient  for  PCS.  We  have  delivered  presenta¬ 
tions  to  the  Cost  Analysis  Improvement  Group, 
Program  Analysis  and  Evaluation,  Office  of  the 
Secretary  of  Defense,  and  thank  them,  espe- 


encouragement  and  support.  Grose  (2004)  ex¬ 
hibits  additional  underlying  detail.  Since  this 
writing,  a  number  of  revisions  to  the  ECS  pro¬ 
gram  and  its  nominal  schedule  have  already 
arisen,  and  these  are  reported  in  the  open  press, 
where  we  direct  interested  readers. 
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APPENDIX:  THREE  ALTERNATE  PLANS  EOR  ECS  SYSTEMS  DEVELOPMENT  AND 
DEMONSTRATION 

Summary  description  tasks  are  in  bold  text  (Microsoft,  2004).  Zero-duration  tasks  are  milestones. 


Baseline  Plan: 

ID 

Task  Name 

Estimated  Cost 

Duration 

Successors 

($M) 

(Weeks) 

1 

Notional  Start 

0.00 

0 

24,13,3 

2 

Major  Events 

3 

Milestone  B  Complete 

0.00 

0 

4,67,37,29,25,14 

4 

SFR  (System  Functional  Review) 

0.00 

0 

5,16,26 

5 

SoS  PDR  Complete 

0.00 

0 

6,17 

6 

SoS  CDR  Complete 

0.00 

0 

7 

7 

Facilitation 

0.00 

0 

8,95 

8 

LL  IPR  Waiver 

0.00 

0 

9,97 

9 

IPD  (Milestone  C) 

0.00 

0 

10,77 

10 

IOC 

0.00 

0 

11,32 

11 

UA 

0.00 

0 

101 

12 

SoS  Definition  and  Design 

13 

Systems  Engineering 

571.42 

104 

5 

14 

Systems  Design 

1,428.57 

260 

10 

15 

Prototype  Systems  Build  and  Test 

16 

1st  Variant  PDC  (Preliminary  Design 

Complete) 

0.00 

0 

17 

17 

Last  Variant  PDC  (Preliminary  Design 
Complete) 

0.00 

0 

18,20,44 

18 

Long  Lead  Prototype 

800.00 

52 

19,21 

19 

Prototype  Integration  and  Assembly 

1,200.00 

78 

22 

20 

First  Variant  CDC  (Critical  Design  Complete) 

0.00 

0 

69,21 

21 

Last  Variant  CDC  (Critical  Design  Complete) 

0.00 

0 

22,6 

22 

Final  Prototype 

0.00 

0 

97,8 

23 

C4ISR  Software  and  Platform 

24 

SW  Build  1 

507.93 

104 

27,44 

25 

SW  Build  2 

634.92 

130 

27,34,69,31,46,52,59 

26 

SW  Build  3 

825.39 

169 

28,52,59 

27 

SW  Build  4 

571.42 

117 

9,63,59 

28 

SW  Build  5 

507.93 

104 

83,89,64 

29 

SIL  Delivery  1  (System  Integration  Lab) 

253.96 

52 

68,33,30 

30 

SIL  Delivery  2 

253.96 

52 

69,31,27,52 

31 

SIL  Delivery  3 

253.96 

52 

32,28 

32 

SW  Update 

190.47 

39 

11,80 

33 

Software  PDR  Complete 

0.00 

0 

34,5 

34 

Software  CDR  Complete 

0.00 

0 

6 

35 

Integrated  Test  Program 

36 

IPSl  (Integration  Phase  SDD  1) 

37 

SoSIL  Development 

280.99 

51 

38,39,30 

38 

Integration 

71.62 

13 

41,5,40 

39 

Sims  Delivered 

0.00 

0 

40 

40 

IT  and  UT 

71.62 

13 

42 

41 

TRR 

0.00 

0 

42 

42 

Analysis 

71.62 

13 

45,44 

43 

IPS2 

44 

Integration 

280.99 

51 

47,6,46 

45 

Early  Emulators  Delivered 

0.00 

0 

46 

46 

IT/UT 

71.62 

13 

48 

47 

TRR 

0.00 

0 

48 

48 

Analysis 

71.62 

13 

50,51,28 

49 

IPS3 

50 

Integration 

209.36 

38 

53,52 
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APPENDIX:  Continued 


ID 

Baseline  Plan: 

_  ,  . ,  Estimated  Cost 

Task  Name 

Duration 

(Weeks) 

Successors 

51 

Initial  DP  Prime  Items  Delivered 

0.00 

0 

52 

52 

IT  and  UT 

71.62 

13 

54,55 

53 

TRR 

0.00 

0 

54,55 

54 

Analysis 

104.68 

19 

58,8 

55 

User  Trial 

11.01 

2 

57 

56 

IPS4 

57 

Integration 

187.32 

34 

60,59 

58 

Initial  System  Deliveries 

0.00 

0 

59 

59 

IT  and  UT 

71.62 

13 

61,63,72 

60 

TRR 

0.00 

0 

61 

61 

Analysis 

71.62 

13 

9 

62 

IPS5 

63 

Integration 

209.37 

38 

64 

64 

IMT 

71.63 

13 

65 

65 

Analysis 

71.63 

13 

77,100 

66 

SoS  Testing  and  Integration 

67 

Phase  1:  Integration  and  Test  SDD  (Simulation) 

183.75 

78 

70,5 

68 

Phase  2:  HW  and  SW 

214.37 

91 

6,95 

69 

Phase  3:  Prototype 

214.37 

91 

72,57,8 

70 

Integration  and  Qualification  and  Live  Fire 

489.99 

208 

73,9,76 

Tests 

71 

Test  Events  and  Milestones 

72 

LUT  1 

4.71 

2 

73 

73 

LUT2 

4.71 

2 

77,79,74,98,99 

74 

lOT  (Initial  Operational  Test)  Phase  1 

47.11 

20 

10,75 

75 

lOT  Phase  2 

44.76 

19 

80 

76 

Integration  and  Test  Production 

214.37 

91 

10,80 

77 

FUSE 

244.99 

104 

80,11 

78 

Training  and  Fielding 

244.99 

104 

80 

79 

lOTE  1 

61.25 

26 

80 

80 

lOTE  2 

30.62 

13 

11 

81 

Combat  Systems  Testing 

82 

Phase  1:  TRIP  Prime  Items 

83 

Integration 

634.15 

39 

85,89,100 

84 

TRIP  PI  for  SoSIL 

0.00 

0 

85 

85 

TRIP  PI  for  TFT  Delivered 

0.00 

0 

86 

86 

Testing 

211.38 

13 

87,90 

87 

Analysis 

211.38 

13 

92,74,79 

88 

Phase  2:  TRIP  Late  TRIP  PI 

89 

Integration 

520.33 

32 

91 

90 

TRIP  PI  for  SoSIL 

0.00 

0 

91 

91 

LRIP  PI  for  TFT  Delivered 

0.00 

0 

92 

92 

Testing 

211.38 

13 

93 

93 

Analysis 

211.38 

13 

11,10,32 

94 

Production 

95 

Facilitation  (Pre-LL  Production) 

682.93 

52 

100,84,96 

96 

Facilitation  (LL  Production) 

1,195.12 

91 

100,84 

97 

Long  Lead  Lot  1 

682.93 

52 

98,99,100,9,83,84,76 

98 

Lot  1 

1,024.39 

78 

79,78 

99 

Lot  2 

1,707.32 

130 

11,80 

100 

Lot  3 

1,707.32 

130 

11,80 

101 

Notional  End  Task 

0 

0 
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APPENDIX:  GAO  "Risk  First":  Mitigate  High  Risk  Technologies  First 


ID 

Task  Name 

Estimated  Cost 

Duration 

Successors 

($M) 

(Weeks) 

1 

Notional  Start 

0.00 

0 

57,13,3 

2 

Major  Events 

3 

Milestone  B  Complete 

0.00 

0 

4,100,70,62,58,14 

4 

SFR  (System  Functional  Review) 

0.00 

0 

5,49,59 

5 

SoS  PDR  Complete 

0.00 

0 

6,50 

6 

SoS  CDR  Complete 

0.00 

0 

7 

7 

Facilitation 

0.00 

0 

8,128 

8 

LL  IPR  Waiver 

0.00 

0 

9,130 

9 

IPD  (Milestone  C) 

0.00 

0 

10,110 

10 

IOC 

0.00 

0 

11,65 

11 

UA 

0.00 

0 

134 

12 

SoS  Definition  and  Design 

13 

Systems  Engineering 

571.43 

104 

5 

14 

Systems  Design 

1,428.57 

260 

10 

15 

Prototype  Systems  Build  and  Test 

16 

TRF  Mitigation  (Technology  Readiness  Level) 

17 

KPP  1:  Joint  Interoperability 

18 

Interface  and  Information  Exchange 

113.24 

65 

4 

19 

KPP  2:  Networked  Battle  Command 

20 

Security  Systems  and  Algorithms 

249.13 

143 

6 

21 

Quality  of  Service  Algorithms 

67.94 

39 

3 

22 

Wideband  Waveforms 

181.18 

104 

5 

23 

Multispectral  Sensors  and  Seekers 

90.59 

52 

3 

24 

Combat  Identification 

22.65 

13 

3 

25 

Sensor  and  Data  Fusion  and  Data  Compression 

67.94 

39 

3 

26 

KPP  3:  Networked  Lethality 

27 

Dynamic  Sensor-Shooter  Pairing  and  Fire  Control 

90.59 

52 

3 

28 

LOS  and  BLOS  and  NLOS  Precision  Munitions 
Guidance 

271.78 

156 

6 

29 

Aided  Target  Recognition 

67.94 

39 

3 

30 

Auto  Target  Recognition 

181.18 

104 

5 

31 

Recoil  Management  and  Lightweight 
Components 

90.59 

52 

3 

32 

Distributed  Collaboration  of  Manned  and 
Unmanned  Vehicles 

226.48 

130 

5 

33 

Rapid  Battle  Damage  Assessment 

67.94 

39 

3 

34 

KPP  4:  Transportability 

35 

High  Power  Density  and  Fuel  Efficient 
Propulsion 

90.59 

52 

3 

36 

KPP  5:  Sustainability  and  Reliability 

37 

Embedded  Predictive  Logistic  Sensors  and 
Algorithms 

90.59 

52 

3 

38 

Water  Generation  and  Purification 

90.59 

52 

3 

39 

KPP  6:  Training 

40 

Computer  Generated  Forces 

22.65 

13 

3 

41 

Tactical  Engagement  Simulation 

45.30 

26 

3 

42 

KPP  7:  Survivability 

43 

Active  Protection  System 

22.65 

13 

3 

44 

Signature  Management 

90.59 

52 

3 

45 

Lightweight  hull  and  Vehicle  Armour 

10.45 

6 

3 

46 

Power  Distribution  and  Control 

10.45 

6 

3 

47 

Advanced  Countermine  Technology 

226.48 

130 

5 

48 

High  Density  Packaged  Power 

10.45 

6 

3 

49 

1st  Variant  PDC  (Preliminary  Design  Complete) 

0.00 

0 

50 

50 

Last  Variant  PDC  (Preliminary  Design  Complete) 

0.00 

0 

51,53,77 
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APPENDIX:  Continued 


ID 

Task  Name 

Estimated  Cost 
($M) 

Duration 

(Weeks) 

Successors 

107 

lOT  (Initial  Operational  Test)  Phase  1 

47.11 

20 

10,108 

108 

lOT  Phase  2 

44.76 

19 

113 

109 

Integration  and  Test  Production 

214.37 

91 

10,113 

110 

FUST 

244.99 

104 

113,11 

111 

Training  and  Fielding 

244.99 

104 

113 

112 

lOTE  1 

61.25 

26 

113 

113 

lOTE  2 

30.62 

13 

11 

114 

Combat  Systems  Testing 

115 

Phase  1:  TRIP  Prime  Items 

116 

Integration 

634.15 

39 

118,122 

117 

LRIP  PI  for  SoSIL 

0.00 

0 

118 

118 

LRIP  PI  for  TFT  Delivered 

0.00 

0 

119 

119 

Testing 

211.38 

13 

120,123 

120 

Analysis 

211.38 

13 

125,107,112 

121 

Phase  2:  LRIP  Late  LRIP  PI 

122 

Integration 

520.33 

32 

124 

123 

LRIP  PI  for  SoSIL 

0.00 

0 

124 

124 

LRIP  PI  for  TFT  Delivered 

0.00 

0 

125 

125 

Testing 

211.38 

13 

126 

126 

Analysis 

211.38 

13 

11,10 

127 

Production 

128 

Facilitation  (Pre-LL  Production) 

833.33 

65 

129 

129 

Facilitation  (LL  Production) 

1,166.67 

91 

133,117 

130 

Long  Lead  Lot  1 

666.67 

52 

131,132,133,9,116,117 

131 

Lot  1 

1,000.00 

78 

112,111 

132 

Lot  2 

1,666.67 

130 

11,113 

133 

Lot  3 

1,666.67 

130 

11,113 

134 

Notional  End  Task 

0.00 

0 
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APPENDIX:  GAO  "C4ISR  First":  Develop  C4ISR  Infrastructure  First 


ID 

Task  Name 

Estimated  Cost 

Duration 

Successors 

($M) 

(Weeks) 

1 

Notional  Start 

0 

0 

24,13,3 

2 

Major  Events 

3 

Milestone  B  Complete 

0 

0 

4,67,37,29,25,14 

4 

SFR  (System  Functional  Review) 

0 

0 

5,26 

5 

SoS  PDR  Complete 

0 

0 

6,16 

6 

SoS  CDR  Complete 

0 

0 

7,17 

7 

Facilitation 

0 

0 

8,95 

8 

LL  IPR  Waiver 

0 

0 

9,97,21 

9 

IPD  (Milestone  C) 

0 

0 

10,77 

10 

IOC 

0 

0 

11,32 

11 

UA 

0 

0 

101 

12 

SoS  Definition  and  Design 

13 

Systems  Engineering 

571.43 

104 

5 

14 

Systems  Design 

1428.57 

260 

10 

15 

Prototype  Systems  Build  and  Test 

16 

1st  Variant  PDC  (Preliminary  Design 

Complete) 

0 

0 

17 

17 

Last  Variant  PDC  (Preliminary  Design 
Complete) 

0 

0 

18 

18 

Long  Lead  Prototype 

800 

52 

19,20,21 

19 

Prototype  Integration  and  Assembly 

1200 

78 

22 

20 

First  Variant  CDC  (Critical  Design  Complete) 

0 

0 

95 

21 

Last  Variant  CDC  (Critical  Design  Complete) 

0 

0 

22 

22 

Final  Prototype 

0 

0 

57,69,97,96 

23 

C4ISR  Software  and  Platform 

24 

SW  Build  1 

507.94 

104 

27,44 

25 

SW  Build  2 

634.92 

130 

27,34,69,31,46,52,59 

26 

SW  Build  3 

825.4 

169 

28,52,59 

27 

SW  Build  4 

571.43 

117 

9,63,59 

28 

SW  Build  5 

507.94 

104 

83,89,64 

29 

SIL  Delivery  1  (System  Integration  Lab) 

253.97 

52 

68,33,30 

30 

SIL  Delivery  2 

253.97 

52 

69,31,27,52 

31 

SIL  Delivery  3 

253.97 

52 

32,28 

32 

SW  Update 

190.48 

39 

11,80 

33 

Software  PDR  Complete 

0 

0 

34,5 

34 

Software  CDR  Complete 

0 

0 

6 

35 

Integrated  Test  Program 

36 

IPSl  (Integration  Phase  SDD  1) 

37 

SoSIL  Development 

280.99 

51 

38,39,30 

38 

Integration 

71.63 

13 

41,5,40 

39 

Sims  Delivered 

0 

0 

40 

40 

IT  and  UT 

71.63 

13 

42 

41 

TRR 

0 

0 

42 

42 

Analysis 

71.63 

13 

45,44 

43 

IPS2 

44 

Integration 

280.99 

51 

47,6,46 

45 

Early  Emulators  Delivered 

0 

0 

46 

46 

IT  and  UT 

71.63 

13 

48 

47 

TRR 

0 

0 

48 

48 

Analysis 

71.63 

13 

50,51,28 

49 

IPS3 

50 

Integration 

209.37 

38 

53,52 

51 

Initial  DP  Prime  Items  Delivered 

0 

0 

52 

52 

IT  and  UT 

71.63 

13 

54,55 

53 

TRR 

0 

0 

54,55 

54 

Analysis 

104.68 

19 

58,8 
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APPENDIX:  Continued 


ID 

Task  Name 

Estimated  Cost 

Duration 

Successors 

($M) 

(Weeks) 

55 

User  Trial 

11.02 

2 

57 

56 

IPS4 

57 

Integration 

187.33 

34 

60,59 

58 

Initial  System  Deliveries 

0 

0 

59 

59 

IT  and  UT 

71.63 

13 

61,63,72 

60 

TRR 

0 

0 

61 

61 

Analysis 

71.63 

13 

9 

62 

IPS5 

63 

Integration 

209.37 

38 

64 

64 

IMT 

71.63 

13 

65 

65 

Analysis 

71.63 

13 

77,100 

66 

SoS  Testing  and  Integration 

67 

Phase  1:  Integration  and  Test  SDD 

183.75 

78 

70,5 

(Simulation) 

68 

Phase  2:  HW  and  SW 

214.37 

91 

6,95,57 

69 

Phase  3:  Prototype 

214.37 

91 

72 

70 

Integration  and  Qualification  and  Live  Fire 

489.99 

208 

73,9,76 

Tests 

71 

Test  Events  and  Milestones 

72 

LUT  1 

4.71 

2 

73 

73 

LUT  2 

4.71 

2 

77,79,74,98,99,76 

74 

lOT  (Initial  Operational  Test)  Phase  1 

47.11 

20 

10,75 

75 

lOT  Phase  2 

44.76 

19 

80 

76 

Integration  and  Test  Production 

214.37 

91 

10,80 

77 

FUSE 

244.99 

104 

80,11 

78 

Training  and  Fielding 

244.99 

104 

80 

79 

lOTE  1 

61.25 

26 

80 

80 

lOTE  2 

30.62 

13 

11 

81 

Combat  Systems  Testing 

82 

Phase  1:  TRIP  Prime  Items 

83 

Integration 

634.15 

39 

85,89,100 

84 

TRIP  PI  for  SoSIL 

0 

0 

85 

85 

TRIP  PI  for  TFT  Delivered 

0 

0 

86 

86 

Testing 

211.38 

13 

87,90 

87 

Analysis 

211.38 

13 

92,74,79 

88 

Phase  2:  TRIP  Late  TRIP  PI 

89 

Integration 

520.33 

32 

91 

90 

LRIP  PI  for  SoSIL 

0 

0 

91 

91 

LRIP  PI  for  TFT  Delivered 

0 

0 

92 

92 

Testing 

211.38 

13 

93 

93 

Analysis 

211.38 

13 

11,10,32 

94 

Production 

95 

Facilitation  (Pre-LL  Production) 

682.93 

52 

100,84,96 

96 

Facilitation  (LL  Production) 

1195.12 

91 

100,84 

97 

Long  Lead  Lot  1 

682.93 

52 

98,99,100,9,83,84,76 

98 

Lot  1 

1024.39 

78 

79,78 

99 

Lot  2 

1707.32 

130 

11,80 

100 

Lot  3 

1707.32 

130 

11,80 

101 

Notional  End  Task 

0 

0 
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